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INTRODUCTION 


Conventional  thinking  has  held  that  when  noise  or  some  exonogeous  disturbance 
is  added  to  a  physical  system,  generally  most  performance  measures  degrade, 
accordingly.  For  a  linear  system,  it  can  be  shown  (Appendix  A)  that  any  addition  of 
noise  will  degrade  the  signal/noise  ratio  as  seen  at  the  output  in  a  monotonic  manner. 
Thus  noise  is  not  generally  viewed  as  a  welcome  addition  to  a  working  system. 

For  certain  classes  of  nonlinear  systems,  however,  it  will  be  shown  that  there  are 
some  advantages  in  adding  small  amounts  of  noise  in  the  sense  that  specific  outputs  (and 
the  ratio  of  these  outputs  to  specialized  (deterministic)  inputs)  may  be  enhanced  to  some 
degree.  Appendix  B  presents  a  mathematical  derivation  on  why  such  an  effect  should 
occur  for  certain  classes  of  nonlinear  systems.  Appendix  C  describes  a  wide  class  of 
nonlinear  systems  that  will  benefit  from  this  SR  (stochastic  resonance)  effect.  A 
literature  review  is  first  presented  on  the  concept  of  stochastic  resonance  to  set  the  stage 
for  the  use  of  this  methodology  with  application  in  the  design  of  human-machine 
interface  devices. 


LITERATURE  REVIEW 

Stochastic  resonance  was  first  reported  in  1981  as  an  explanation  of  why  the 
Earth’s  ice  ages  have  a  100,000-year  periodicity,  when  the  correct  period  should  be  a 
factor  of  ten  higher  (Benzi  et  al.,  1981).  Experimentally,  stochastic  resonance  was 
initially  demonstrated  in  an  electronic  circuit  known  as  the  Schmitt  trigger  (Fauve  and 
Heslot,  1983).  Stochastic  resonance  effects  have  been  described  in  a  wide  range  of 
physical  systems  including  crayfish  (Wiesenfeld  and  Moss,  1995),  neural  spike  trains  and 
neurons  (Richardson  et  ah,  1998,  Longtin,  1993,  and  Svirskis  and  Rinzel,  2000),  in 
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human  tactile  sensation  (Cordo,  et  al.,  1996,  and  Collins,  et  al.,  1996a,  1997),  in  atomic 
force  microscopes  (Rajaram  et  al.,  2000,  Basso,  et  al.,  1999)  and  in  extended  systems 
(Bulsara  and  Gammaitoni,  1996).  The  theory  of  stochastic  resonance  describes  how  the 
signal  to  noise  ratio  of  a  nonlinear  system  may  be  improved  by  the  small  insertion  of  a 
random  signal  (McNamara  and  Weisenfeld,  1989  and  Heneghan,  et  al.,  1996).  The 
deterministic  input  signal  (different  from  the  noise  input)  to  the  nonlinear  system  does 
not  have  to  be  strictly  periodic  (Collins  et  al.,  1995b,  1996b),  but  such  a  weak  signal  can 
be  shown  to  be  amplified  by  the  noise  process  in  the  presence  of  a  threshold 
(Gammaitoni,  et  al.,  1998,  and  Collins,  et  al.,  1995a).  The  process  of  stochastic  resonance 
can  be  performed  adaptively  (Yang,  et  al.,  1998),  and  for  multiple  systems  in  parallel 
(Gailey,  et  al.,  1997).  Such  effects  are  shown  in  physiological  systems  (Christini  and 
Collins,  1997)  since  such  structures  have  nonlinear  dynamics,  which  are  amenable  to  this 
approach  (Martin  and  Schovanec,  1997,  and  Wilson,  1999).  It  is  interesting  to  note  that  as 
early  as  1976,  it  was  reported  in  the  literature  that  small  amounts  of  dither  (noise  or  a 
signal  orthogonal  to  an  original,  deterministic,  input  signal)  into  a  nonlinear  system  could 
enhance  its  stability  as  well  as  improve  other  performance  measures  (Zames  and 
Shneydor,  1976).  The  SR  process  has  now  been  applied  to  many  dynamically  diverse 
systems,  which  are  too  numerous  to  describe.  The  goal  here  is  to  employ  this  concept  to 
the  design  of  a  human-machine  interface  in  some  manner,  which  is  optimal  with  respect 
to  a  selected  system  response  characteristic. 

To  understand  how  SR  works,  it  is  worthwhile  to  first  formulate  and  describe  the 
process  within  the  context  of  a  block  diagram  description. 
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Block  Diagram  Description 

With  reference  to  Figure  1,  the  nonlinear  system  of  interest  has  two  inputs.  The 
first  input  is  S(t)  (deterministic  signal)  which,  for  simplicity,  is  assumed  to  be  a  periodic 
waveform.  The  stochastic  or  second  input  is  the  noise  term  £(t),  which  is  assumed  to  be  a 
white-gaussian  process.  The  output  of  the  system  in  Figure  1  is  the  state  vector  x(t)  and 
the  goal  is  to  maximize  some  measure  of  transfer  characteristics  (x/S)  between  the  output 
variable  x(t)  and  the  deterministic  signal  S(t)  input.  Typically  this  transfer  characteristic 
may  be  the  signal  to  noise  ratio,  which  could  be  of  interest,  for  example,  in  a 
communication’s  system.  To  understand  why  such  a  methodology  would  work,  a  simple 
physics  example  clearly  shows,  in  a  physical  sense,  why  such  a  phenomenon  has  some 
utility  in  certain  types  of  natural  processes. 

A  Physics  Example  to  Illustrate  the  SR  Effect 
Figure  2  portrays  a  configuration  that  physicists  commonly  call  a  bi-potential  well 
problem.  The  physical  relationship  of  the  block  diagram  of  Figure  1  to  the  system  in 
Figure  2  can  be  understood  by  discussing  the  behavior  of  the  small  ball  trapped  inside  the 
left-most  potential  well  in  Figure  2.  The  input  variable  S(t)  is  the  displacement  of  the  ball 
to  the  right  or  left.  The  output  variable  is  x(t),  which  is  the  horizontal  position  of  the  ball 
in  the  well.  The  ball  is  initially  trapped  in  the  left  most  well  because  the  signal  S(t)  does 
not  have  sufficient  strength  to  climb  the  barrier  height  h  and  move  from  a  State  1  position 
to  a  State  2  position.  Thus  the  ball  stays  in  State  1  if  the  signal  S(t)  is  of  a  periodic  nature 
but  never  has  sufficient  magnitude  to  drive  the  ball  to  a  vertical  height  in  excess  of  h 
units  (the  height  of  the  potential  well).  However,  if  a  noise  signal  is  now  added  to  S(t),  it 
may  be  possible  for  the  ball  to  reach  the  height  h,  go  right,  pass  through  the  origin,  and 
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move  onto  State  2  in  the  diagram.  Also  if  the  ball  is  in  State  2  and  there  was  no  noise 
disturbance,  then  the  ball  would,  again,  be  trapped  in  that  state  forever.  With  sufficiently 
large  values  of  noise  added  to  the  signal  S(t),  then  the  ball  can  move  freely  between  the 
two  states.  Without  the  noise,  the  ball  can  never  switch  states.  Too  much  noise  power. 


Figure  1  -  The  Process  of  Producing  Stochastic  Resonance 


however,  can  cause  performance  degradation.  With  too  high  of  a  noise  intensity  added  to 
S(t),  one  can  see  the  ball  would  switch  states  so  frequently  that  the  output  of  the  system 
(jc(t))  would  appear  to  represent,  mainly,  a  stochastic  disturbance  with  a  noise  power 
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significantly  higher  than  the  deterministic  signal  S(t).  In  this  case  the  noise  would  mask 
S(t),  which  is  not  the  desired  result.  Hence  the  benefit  is  reduced  when  too  much  noise  is 
added.  Figure  3  illustrates  equilibrium  points  for  the  dynamical  system  in  Figure  2  based 
on  physical  considerations.  The  points  denoted  as  +  a  are  the  stable  equilibrium  points 
and  the  origin  is  classified  as  an  unstable  equilibrium  point.  Obviously  the  system,  when 
perturbed  from  the  stable  equilibrium  points  (+  a),  returns  to  the  original  stable  state 
(assuming  small  perturbations).  For  the  unstable  equilibrium  point  at  the  origin, 
however,  small  perturbations  move  the  ball  away  from  the  origin  in  either  direction; 
hence  the  origin  is  at  an  unstable  equilibrium  point.  A  mathematical  formulation  of  the 
physical  system  in  Figure  2  will  be  described  in  the  sequel  demonstrating  additional 
aspects  of  the  equilibrium  points  denoted  in  Figure  3.  It  will  be  shown  that  only  a 
nonlinear  system  could  generate  this  stochastic  resonance  effect,  but  these  nonlinear 
systems  occur  quite  commonly  in  nature.  Hence  this  design  has  applicability  to  a  diverse 
number  of  physical  processes  (Appendix  C).  It  is  worthwhile  to  consider  an  alternative 
representation  of  Figures  2-3  in  which  the  signal  S(t)  may  be  alternatively  viewed  as  a 
subthreshold  input  which  stays  less  than  a  threshold  value  analogous  to  the  height  of  the 
potential  well,  denoted  as  h  in  Figure  2. 

A  Threshold  Formulation  of  the  Stochastic  Resonance  Effect 

Figure  4  illustrates  an  alternative  means  of  describing  SR  within  the  context  of  a 
sub  threshold  signal.  In  the  top  most  chart  of  Figure  4,  it  is  seen  that  the  signal  S(t)  is  the 
subliminal  signal  characterized  as  the  trapezoidal  input  below  the  threshold  value  h.  The 
objective  is  to  detect  the  subliminal  signal  S(t)  when  it  may  be  subthreshold.  This  may  be 
viewed  as  providing  a  means  of  reducing  the  threshold  level  h  in  Figure  4.  The  variable  h 
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in  Figure  4  is  analogous  to  the  h  in  Figure  2.  The  middle  chart  in  Figure  4  shows  what 
happens  when  a  small  amount  of  random  noise  is  added  to  the  subliminal  signal.  It  is  now 
obvious  that  when  the  combined  noise  and  the  S(t)  signal  are  sufficiently  high,  the 
subliminal  signal  now  pierces  through  the  threshold  and  the  signal  is  detected.  Thus  there 
has  been  a  reduction  of  missed  negatives  to  the  detection  of  the  threshold  signal  when 
S(t)  is  high  and  added  to  the  noise  disturbance.  The  bottom  chart  of  Figure  4  shows  the 
same  signal  S(t)  now  added  to  a  noise  source  with  a  high  variance  (or  noise  power).  Here 
the  signal  is  correctly  detected  when  S(t)  is  high,  but  it  is  also  mistaken  when  the  original 
subliminal  signal  was  low.  Thus  the  missed  negatives  in  the  detection  process  are  now 
practically  nonexistent,  however,  the  false  positives  (detecting  the  signal  when  it  is  not 
high)  are  increasing.  Hence  too  much  noise  degrades  the  decision  making  process  of 
detecting  a  subliminal  signal  by  increasing  the  false  positives  to  the  point  where  they 
produce  incorrect  decisions.  Figure  5  now  combines  this  description  with  Figure  4  to 
show  how  the  resonance  actually  occurs. 

In  Figure  5,  the  top  of  the  diagram  is  the  previous  Figure  4.  The  bottom  illustration  is 
a  plot  (dependent  variable)  proportional  to  the  probability  of  detection  of  the  subliminal 
signal  versus  the  variance  or  the  power  in  the  noise  source  (independent  variable).  For 
the  bottom  diagram,  as  the  noise  is  small  (in  variance,  going  up  the  left  side  of  the  SR 
curve),  moving  to  the  right,  it  is  observed  that  the  number  of  missed  negatives  decreases 
(for  increasing  noise  power)  but  the  number  of  false  positives  starts  to  increase.  A  peak 
point  (resonance  point)  is  reached  in  which  the  number  of  missed  negatives  has 
significantly  decreased  (at  the  expense  of  including  some  false  positives)  so  the  decision 
rule  is  optimal.  To  the  right  of  this  resonance  point,  the  number  of  false  positives  keeps 
increasing  but  the  value  gained  from  reducing  any  additional  missed  negatives  are  not 
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Now  Add  a  Little  Noise  to  the  Subliminal  Signal 
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Now  Add  a  Lot  of  Noise  to  the  Subliminal  Signal 
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Figure  5 

Transfer  Characteristics 


Optimum  Noise  Power 
to  Add  to  The  System 


of  great  utility.  Consequently  the  decision  rule  now  suffers  as  the  noise  power  increases 
and  eventually  there  is  little  benefit  in  the  decision  process  from  increasing  the  noise. 
The  key  point  in  Figure  5  is  that  a  most  favorable  point  exists  where  the  noise  makes  the 
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system  an  optimal  decision  maker,  much  better  than  the  case  of  having  no  noise.  At  this 
resonant  point,  the  decision  maker  has  minimized  his  missed  negatives  at  the  expense  of 
absorbing  a  small  number  of  false  positives.  This  is  his  best  operating  point  because 
reducing  any  more  missed  negatives  adds  substantially  more  false  positives,  thus 
compromising  the  overall  decision  making  process.  Note  that  for  the  no  noise  situation, 
since  S(t)  is  a  subliminal  signal,  all  responses  are  missed  negatives.  There  are  no  false 
positives  but  the  decision  maker  is  also  not  aware  of  the  subliminal  signal.  Thus,  the 
noise  helps  the  decision  maker  perform  better  as  compared  to  the  situation  of  having  no 
noise  at  all.  It  is  desired  to  now  apply  this  concept  in  the  design  of  human-machine 
interface  devices.  One  can  view  the  human  operator  as  a  decision  maker  who  makes 
errors  and  is  exposed  to  various  types  of  uncertainties  both  externally  from  an 
exonogeous  environment  as  well  as  internally  through  faulty  measurement  and  detection 
processes  inherent  in  the  human  sensing  system.  For  the  human-interface  design  problem 
to  be  described,  the  role  of  the  noise  will  be  to  stimulate  and  enhance  the  alternative 
sensory  modality  information  channels  of  the  operator  about  the  remote  tracking  task. 

The  goal  will  be  to  expand  on  the  ability  of  the  human  to  perform  or  make  better 
decisions  via  improved  signal/noise  characteristics  or  transinformation  capability. 


Objectives  of  The  SR  Study 

The  intention  of  this  study  was  to  investigate  if  decision  making,  which  may  be 
manifested  by  tracking  performance  improvements,  or  might  be  improved  as  a 
consequence  of  noise  injection  into  a  multisensory  study  involving  a  haptic  stick  and  a 
motion  chair  device.  The  appropriate  level  of  noise  injection  is  of  interest  as  well  as  any 
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synergy  that  may  exist  between  the  force  reflecting  joystick  and  the  motion-based  chair 
system.  The  tracking  task  is  of  a  disturbance  rejection  type  representing  a  flying 
situation,  e.g.  a  helicopter  hovering  above  a  fixed  (low)  altitude  for  a  search  and  rescue 
mission.  Typically  in  such  situations,  the  pilot  has  to  maintain  an  unvarying  altitude  and 
orientation  (constant  pose)  and  is  subjected  to  extremely  high  wind  turbulence  induced  by 
the  presence  of  the  helicopter  being  so  proximal  to  the  ground.  This  is  a  disturbance 
rejection  task  in  the  truest  sense  of  the  word.  The  pilot  has  to  maintain  a  “status  quo”  set 
point  condition  in  the  presence  of  external  disturbances  such  as  wind  turbulence.  Thus 
the  pilot  has  to  reject  the  disturbances  to  maintain  a  constant,  fixed  pose,  in  space.  These 
objectives  can  be  stated  by  the  following  hypothesis. 

Hypothesis  of  The  SR  Study 

The  null  hypothesis  we  wish  to  reject  is  that  the  haptic  stick  and/or  the  proprioceptive 
information  provided  by  the  chair  motion  device  provides  no  performance  advantage 
(using  different  dependent  measures)  in  this  disturbance  rejection  task.  Thus  it  is  desired 
to  reject: 

Ho:  Either  the  haptic  stick  or  the  motion  feedback  provided  by  a  laterally  translating 
chair  do  not  influence  tracking  performance  in  a  disturbance  rejection  task. 
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METHOD 


Subjects 

A  total  of  nine  subjects  participated  in  this  experiment.  A  subject  panel  from  a 
local  contractor  at  the  Wright-Patterson  Air  Force  Base  in  Ohio,  USA  provided  five  of 
the  participants.  These  adult  people  were  either  housewives  or  students  at  a  local 
university  being  employed  part  time.  The  compensation  for  participation  in  this 
experiment  was  about  $6  dollars  (US)  an  hour  for  their  participation.  The  remainder  of 
•the  subjects  were  a  US  Air  Force  civil  servant  and  contractor  personnel. 

Apparatus-The  Motion  Based  Chair  Facility 

This  single-axis  motion  platform  was  outfitted  with  a  dual  axis  force  reflecting 
joystick  controller  (Immersion  2000)  as  displayed  in  Figure  6  with  the  experimental 
design  conditions  portrayed  in  Figure  7.  This  device  was  constructed  from  a  welded 
aluminum  frame  rigidly  supporting  a  racing  car  seat.  Padded  armrests  are  configured  at 
an  elbow  level,  while  the  joystick  is  mounted  such  that  its  handle  may  be  comfortably 
grasped  by  a  seated  pilot’s  right  hand.  Joystick  motion  was  restricted  to  the  lateral  axis, 
the  axis  parallel  to  the  motion  of  the  chair.  The  entire  frame  translates  sideways  on  a  Ball 
Screw  assembly  with  an.  18-inch  stroke.  Translation  is  driven  by  a  Kollmorgen  Model  B- 
404-B  DC  Servo  Motor,  which  is  rated  at  4.5  hp.  The  motion  based  chair  which  resides 
in  the  Human  Sensory  Feedback  Laboratory  at  WPAFB  was  built  to  investigate  the 
effects  of  chair  motion  and  force  feedback  (via  the  joystick)  on  human  performance.  The 
bandwidth,  range  of  lateral  motion  travel,  velocities  and  accelerations  are  depicted  in 
Table  I  to  describe  the  capability  of  this  hardware  system. 
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Table  I  -  Hardware  Specifications  of  the  Motion  Chair  Device  in  Figure  6 


Performance  Parameters  i 

Nominal  Case 

Worst  Case  Values 

Frequency  (Bandwidth  of 
Motion  Response  of  Chair) 

3  Hz 

4  Hz 

Range  of  Travel 

±.5cm 

+_  7.5  cm 

Peak  Velocity 

1  meter/second 

1 .8  meters/second 

Peak  Acceleration 

Approximately  2  G 

Approximately  4.5  G 

The  Haptic  Stick  Controller 

The  Immersion  IE  (Impulse  Engine)-2000  powered  joystick  is  a  two-degree  of 
freedom  force-reflecting  manipulandum  used  in  haptic  experiments.  It  generates  about 
4.04  Newtons  maximum  force  at  the  handle  grip  to  the  human  operator,  which  is 
displaced  0.1397  meters  from  a  pivot  point.  This  device  measures  position  displacement 
of  the  stick  through  digital  encoders  and  applies  a  force  feedback  interface  via  a  cable 
drive.  The  force  reflection  algorithms  are  programmable  in  C+  code.  The  forces 
generated  by  this  haptic  device  are  independent  of  the  chair’s  motion  but  the  chair  may 
induce  a  physical  interaction  upon  the  human  operator  to  generate  biodynamic 
feedthrough  at  the  joystick. 


Experimental  Design 

The  Performance  Task  (Disturbance  Rejection) 

The  deterministic  input  tracking  task  S(t)  was  composed  of  the  sum  of  5  distinct 
sine  waves  (prime  number  multiples  of  a  fundamental  harmonic)  of  sufficiently  high 
frequency  content  that  they  appeared  quasi -random  to  the  human  operator.  A  means  of 
developing  such  tracking  tasks  is  discussed,  for  example,  in  the  appendix  of  Repperger  et 
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al.,  1983.  It  is  well  known  that  when  5  or  more  sine  waves  are  randomly  added,  it 
becomes  exceedingly  difficult  for  the  operator  to  predict  the  next  movement  of  the  target; 
hence  it  has  the  appearance  of  a  random  tracking  task,  although  derived  from  a 
deterministic  signal.  The  noise  source  (for  both  the  stick  and  the  chair  motion)  originated 
from  a  random  number  generator.  The  data  were  sampled  at  33.3  Hz  (.030  ms).  At  the 
start  of  the  run,  the  random  number  generator  was  queried  for  an  initial  point  within  a 
uniform  density  function  range  from  zero  to  one.  The  extracted  number  was  multiplied  by 
a  different  initial  constant  each  day  which  provided  the  starting  point  in  selecting  the 
noise  from  a  white-noise  generator.  At  each  sample  point,  the  white  noise  element 
(which  could  be  positive  or  negative)  was  then  determined  and  scaled  by  a  display  gain 
before  being  added  to  the  S(t)  signal.  The  value  of  the  display  gain  was  established  via 
some  pilot  studies  (increased  in  magnitude)  until  at  least  50%  of  the  signal  was  outside 
the  box  depicted  on  the  screen  in  Figure  6.  After  the  pilot  study  was  complete,  the  same 
value  of  display  gain  was  run  for  all  9  subjects  that  participated  in  the  experiment. 

Training 

On  the  first  day,  subjects  tracked  5  runs  of  2  minutes  duration  with  no  chair 
motion  or  stick  feedback.  The  second  and  subsequent  days  they  received  the  four 
experimental  conditions  depicted  in  Figure  7  after  running  the  baseline  condition,  initially 
(the  first  run  was  the  baseline  condition  consisting  of  no  noise  on  the  chair  motion  and  no 
such  disturbance  on  the  joystick).  The  last  four  runs  were  randomized  each  day  to 
mitigate  ordering  effects  and  Figure  7  describes  the  experimental  design  conducted  here. 
The  subjects  trained  by  tracking  the  disturbance  rejection  task  with  the  goal  of 
minimizing  the  error  (centering  the  box  of  1.75  inches  of  width  within  the  domain  of  a 
cursor-cross  in  Figure  6).  The  cursor-cross  consisted  of  two  4  inch  lines  commonly 
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intersecting.  The  subjects  were  seated  in  the  motion  chair  with  a  distance  of  about  65 
inches  from  the  TV  display  monitor.  Light  conditions  were  dimmed  so  that  the  subjects 
could  concentrate  on  the  disturbance  rejection  task.  The  subjects  tracked  five  tasks  each 
day  until  they  showed  less  than  5%  variation  in  their  performance  scores.  Figure  8 
illustrates  a  learning  curve  for  a  typical  subject.  The  dependent  variable  was  the  time  (in 
seconds)  the  cursor  was  outside  the  domain  of  the  box.  The  independent  variable  is  the 
day  number,  and  as  can  be  seen  in  the  diagram,  it  was  not  unusual  for  a  subject  to 
perform  the  experiment  for  15  days  or  more.  The  last  4  days  were  considered  data 
collection  days. 


Data  Analysis 

Fifteen  channels  of  data  were  collected.  The  most  relevant  variables  include  the 
stick  displacement  output,  chair  motion,  stick  force,  target  motion  as  well  as  the  time 
derivatives  of  a  number  of  these  variables.  The  analysis  reported  here  included 
performance  (measured  by  time  on  target  when  the  box  was  totally  outside  the  cursor),  as 
well  as  some  additional  variables  known  to  be  affected  when  haptics  interacts  with  humans 
during  tracking  tasks.  The  motivation  for  using  haptic  manipulandum  devices  is  inspired  by 
the  fact  that  it  is  known,  for  example,  that  the  force  reflection  condition  active  can  mitigate 
spastic  response  of  individuals  (Repperger,  et  al.  1995).  In  a  landing  task  study  during 
wind  turbulence  (Repperger,  et  al.,  1997),  haptics,  which  had  a  spatial  force  reflecting 
condition,  were  shown  to  give  pilots  an  additional  sense  of  presence  when  the  visual 
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Figure  8  -  Typical  Learning  Data  -  Time  off  Target  versus  Day  Number 


scene  may  be  compromised  (reduced  visual  field).  Another  interesting  result  from  the 
prior  haptics  studies  is  that  it  has  been  demonstrated  that  the  percent  of  the  stick  output 
correlated  with  the  target  task  is  substantially  higher  when  performance  is  improved 
(Repperger,  1991).  An  issue  of  interest  in  this  study  is  whether  the  haptics  improved  this 
“efficiency”  of  the  operator  to  better  process  information  as  manifested  by  his  tracking 
performance  as  well  as  how  the  stick  controller  was  utilized.  A  more  “efficient” 
operator  may  be  viewed  as  having  a  stick  output  more  highly  correlated  with  the  target¬ 
tracking  task.  The  prior  haptic  studies  demonstrated  that  by  modulating  the  force 
characteristics  of  the  joystick  manipulandum,  this  important  correlation  variable  could  be 
influenced  and  improved. 
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Experimental  Scenario 


The  experimental  design  was  a  two  variable,  full  factorial,  and  repeated  measures. 
This  implies  each  subject  was  exposed  to  all  treatment  conditions  (within  subject  design, 
hence  each  subjects  acts  as  his  own  control).  The  first  independent  variable  (two  levels) 
was  the  haptic  stick  being  either  low  or  high  (low  corresponds  to  a  displacement  stick 
with  the  addition  of  a  minor  level  of  noise  inputted  via  a  force  reflected  signal).  The  high 
condition  for  the  haptic  stick  represents  a  much  higher  level  of  the  force  feedback  signal 
related  to  the  exogenous  disturbance,  which  is  much  like  that  which  would  occur  in  the 
operational  environment.  The  second  independent  variable  (two  levels)  was  the  chair 
motion  (also  driven  by  the  noise)  being  either  high  or  low.  Again,  the  low  level  of  chair 
motion  was  barely  perceptible.  A  higher  level  of  chair  motion  was  selected  to  be  no 
greater  than  1.5G  maximum  lateral  acceleration.  Several  dependent  performance 
measures  were  considered  with  the  primary  metric  presented  here  as  the  time  the  box 
target  was  sufficiently  removed  from  the  origin  set  point  (outside  the  domain  of  the 
cursor-cross)  which  represented  the  zero  error  position.  This  is  very  akin  to  the 
operational  environment,  e.g.  when  a  helicopter  operator  has  to  maintain  a  constant  pose 
in  a  low  altitude  mission  (search  and  rescue)  where  the  induced  wind  turbulence  creates  a 
significant  problem  in  the  control  of  such  an  air  vehicle. 

RESULTS  OF  THE  SR  PERFORMANCE  STUDY 

The  risk  level  that  we  incorrectly  reject  the  null  hypothesis  (when  Ho  is  true)  was 
selected  as  a  =  .05.  This  gives  a  95%  confidence  in  our  decision  process.  Since  this  was 
a  within  subjects  design,  blocking  across  subjects  normally  occurred  which  reduced  this 
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source  of  variation  (within  a  block,  however,  all  other  experimental  conditions  were 
randomized).  We  look  at  the  main  effects  and  study  their  respective  interactions. 

The  main  dependent  performance  measure  reported  here  was  the  total  time  the  box 
was  outside  the  domain  of  the  cursor-cross  during  the  120-second  run(cf.  Fig.  6).  In  the 
real  world,  this  is  related  to  changes  in  aircraft  lateral  attitude  off  a  desired  set  point.  In 
practice,  this  is  representative  of  a  pilot  maintaining  his  aircraft  attitude  in  some  desired 
inertial  frame  reference  position  when  the  aircraft  is  exposed  to  external  wind  turbulence. 
The  data  described  herein  were  averaged  over  the  nine  subjects  that  participated 
including  replications  of  four  days  for  data  collection.  Figure  9  illustrates  plots  of  the 
mean  values  of  the  time  outside  the  target  error  from  the  desired  orientation  or  pose 
vector  (referenced  to  zero).  The  five  experimental  conditions  displayed  included  the 
baseline  data  (no  noise  on  either  the  stick  or  the  chair  =  COSO),  the  low  level  of  noise  on 
the  haptic  stick  but  with  no  chair  disturbance  =  COS  1 ,  low  levels  of  both  noise  on  the 
haptic  stick  as  well  as  noise  on  the  chair  =  C1S1,  the  case  of  high  stick  noise  and  low 
chair  noise  =  C1S2,  and  finally  the  situation  where  the  stick  noise  is  high  and  the  chair 
noise  was  also  high  =  C2S2.  In  Figure  9,  the  means  of  this  time  off  target  tracking  error 
are  the  lower  part  of  the  bar  graph  (averaged  across  all  nine  subjects)  with  the  respective 
standard  deviation  displayed  as  the  upper  part  of  each  bar  graph. 

Figure  10  illustrates  the  data  for  all  nine  of  the  trained  subjects  to  show  some  of 
the  typical  variability  across  subjects  but  also  portrays  the  consistency  across  the 
treatment  conditions  selected  in  this  experimental  design.  Thus  the  improved  haptic 
condition  affects  individuals  differently,  but  similar  trends  appear  which  are  reflected  in 
the  summary  data  displayed  in  Figure  9. 
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Averages  for  Each  Condition  for  Al  Subjects 


COSO  C0S1  C0S2  C1S1  C1S2 

Condition  Designation 


Figure  9  -  Averages  across  nine  subjects  -  Time  off  Target  Tracking  Error 


Averages  of  Each  Condi  ion  for  Each  Subject 


Figure  10  -  Results  for  the  Individual  Subjects 

Using  the  statistical  package,  SYSTAT®  8.0,  Table  II  illustrates  significant  effects  for 
the  normalized  dependent  measure-time  off  target  from  this  ANOVA.  In  Table  n,  the  p 
value  and  F  values  are  given  for  the  dependent  performance  measure  of  interest. 
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Table  II  -  ANOVA  Results  for  SR  Study  (p  levels<.05*) 


Treatment 

Time  off  Target 

Time  off  Target 

Condition 

Trained 

All  Subjects, 

Subjects 

All  Runs 

Chair  Motion 

p  =  0.052 

F  =  9.747 

p  =.002* 

F  =  20.546 

Haptics 

p  =  0.019* 

F  =5.712 

p  =  0.028* 

F  =  7.159 

Chair  Motion  * 
Haptics 

(Interaction) 

p  =  0.579 

F  =  .386 

p  =  0.415 

F  =  0.740 

Since  both  haptics  and  task  difficulty  showed  main  effects  but  their 
interactions  were  not  significant  (p>.05),  it  is  concluded  that  we  can  reject  the  null 
hypothesis  that  tracking  performance,  using  this  dependent  measure,  was  not  significantly 
affected  by  the  addition  of  the  noise  terms  as  previously  described. 


DISCUSSION  ON  THE  SR  PERFORMANCE  RESULTS 

The  data  described  in  this  report  indicate  that  an  optimal  human  interface  design 
is  possible  with  noise  injected  into  the  sensory  modality  system  in  two  ways.  With 
reference  to  Figure  9,  it  is  observed  that  the  minimum  disturbance  rejection  error  occurs 
when  the  stick  noise  is  low  and  the  chair  noise  is  high.  This  represents  an  “optimal” 
human-machine  interface  design  corresponding  to  the  condition  C1S1  in  Figure  9.  Thus 
a  benefit  has  been  gleaned  by  running  the  human  operator  within  this  scenario.  The 
amount  of  improvement  is  indeed  striking.  Compared  to  the  baseline  condition  (COSO) 
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which  would  be  the  situation  in  a  normal  display,  the  optimum  condition  reduces  the 
mean  time  off  target  error  (across  nine  subjects)  from  7.7  seconds  to  3.34  seconds.  This  is 
a  mean  value  of  56%  reduction  in  time  off  target  error  for  a  disturbance  rejection  task. 
These  results  are  significant,  when  averaged  over  the  subject  pool  and  in  an  operational 
environment,  this  can  mean  the  difference  between  success  and  failure.  Typically,  in 
simulators,  the  COSO  condition  would  represent  an  operator  performing  a  remote  mission 
in  an  UAV  (unmanned  air  vehicle)  system  or  in  an  on-orbit  servicing  task  in  a  space 
operation  scenario  where  the  human  has  minimal  situational  awareness  with  the  remote 
environment.  The  additional  sensory  modality  information  provided  by  the  stick  and  the 
chair  would  assist  in  improving  the  awareness  and  performance  level  of  the  operator  to 
perform  this  remote  task.  A  discussion  of  the  efficacy  of  the  haptic  stick  to  improve 
performance,  situational  awareness,  and  reduce  workload  has  also  been  documented  in 
Heath,  et  al.,  2000  for  the  special  application  of  UAV  systems  and  operators  working 
with  tasks  in  remote  locations  with  reduced  alternative  sensory  modality  information.  It 
is  now  essential  to  discuss  the  issue  of  how  the  operator  used  his  joystick  controller  when 
performing  this  disturbance  rejection  task  when  the  human  interface  system  is  “optimally 
tuned”. 

RESULTS  FROM  THE  STICK  AND  CHAIR  ORTHOGONALITY  STUDY 

Since  the  human-machine  interface  system  has  been  designed  to  optimize  the 
interaction  as  depicted  in  Figure  9,  this  preeminent  design  configuration  provides  an 
opportunity  to  investigate  characteristics  of  this  interaction  that  may  have  been  enhanced. 
In  an  earlier  study  (Repperger,  1991),  it  was  demonstrated  that  when  the  force  reflecting 
joystick  had  force  characteristics  that  were  matched  to  the  “plant  dynamics”  under 
control,  then  two  distinctiveness  of  this  interaction  were  noted  to  occur: 
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(1)  The  percent  of  stick  (displacement)  output  of  the  joystick  correlated  with  the 
target  input  forcing  function  fr(t)  was  the  highest  when  performance  was  most 
improved.  This  result  was  averaged  over  5  pilot  subjects  and  was  a  consistent 
measure  (Repperger,  1991). 

(2)  Also,  the  orthogonal  component  of  the  stick  output  to  the  target  input  forcing 
function  fT(t)  was  lowest  when  performance  was  most  improved. 

From  an  intuitive  perspective,  the  results  above  seem  plausible  for  several 
important  reasons.  First,  when  optimum  tracking  conditions  occur,  (minimum 
tracking  error),  the  stick  commands  must  be  more  useful  in  the  sense  they  effectively 
track  the  target  (have  a  higher  component  of  correlation)  in  reducing  the  closed  loop 
tracking  error.  Similarly,  if  the  orthogonal  component  of  the  stick  output  is 
minimized,  this  implies  the  operator  has  focused  his  stick  commands  in  a  vector 
direction  most  productive  to  good  tracking.  Figure  11a  illustrates  this  concept  from  a 
block  diagram  perspective,  and  Figure  1  lb  is  an  adaptation  of  the  data  from  the  1991 
study  where  (using  Fourier  analysis)  it  was  clearly  demonstrated  of  the  existence  of 
this  inverse  relationship  between  tracking  error  and  percent  of  stick  output  correlated 
with  the  target  forcing  function.  It  seems  plausible  that  the  same  effects  should  have 
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Figure  1  la  -  Block  Diagram  Description  Related  to  the  Stick  Orthogonality  Issue 


Figure  1  lb  -  Tracking  Performance  Results 
Dependent  on  The  Stick  Orthogonality  Relationship 
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also  appeared  in  the  study  described  in  this  report  if  the  human  operator  is  operating 
as  an  efficient  information  processing  system.  To  test  this  concept  in  the  study 
discussed  herein,  the  objective  is  first  stated. 

Objective  in  Studying  Orthogonal  Stick  and  Chair  Response 
If  the  human  operator  is  acting  in  an  efficient  manner  during  the 
“optimally  tuned”  machine-interface  condition  (CIS  1  in  Figure  9),  then  one  would 
conclude  that  larger  portions  of  the  stick  output  commands  from  the  operator  are 
productive  in  the  sense  that  they  are  more  likely  correlated  with  the  target  input 
forcing  function.  This  may  also  be  related  to  correlations  of  the  chair  motion.  In 
terms  of  the  null  hypothesis  we  would  like  to  reject. 

Hypothesis  in  Studying  Orthogonal  Stick  or  Chair  Response 

The  null  hypothesis  we  wish  to  reject  is  that  when  the  operator  is  optimally  tuned 
to  the  human-machine  interface  system,  the  percent  of  stick  (or  chair  motion)  output 
correlated  to  the  target  forcing  function  is  not  an  important  predictor  of  good  tracking 
performance.  Thus  it  is  desired  to  reject: 

Ho\  The  performance  in  the  disturbance  rejection  task  was  not  influenced  or  correlated 
with  the  stick  or  chair  output. 

Data  Analysis  in  Stick  or  Chair  Orthogonality  Study 
For  the  stick  and  chair  data  orthogonality  data  analysis,  first  the  stick  motions 
made  by  the  human  will  be  analyzed.  The  target  input  forcing  function  was  the  sum  of  a 
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5  sine  waves  disturbance  (quasi  random  in  the  sense  it  appears  random  to  the  human,  but 
is  truly  a  deterministic  signal)  which  both  moved  the  target  fT  in  a  lateral  direction  and 
correspondingly  could  move  the  stick  and/or  the  chair  in  the  same  lateral  direction.  The 
first  analysis  deals  with  the  correlation  between  the  stick  output  (a  true  command  input 
from  the  human)  with  its  coherency  with  the  target  tracking  task  using  mean  values 
across  subjects.  Figure  12a  illustrates  the  relationship  between  performance  (good 
performance  is  low  amounts  of  time  off  target  in  a  disturbance  rejection  task)  and  the 
correlation  of  the  position  displacement  of  the  force  reflecting  controller  in  relation  to  the 
target  tracking  task.  One  may  compare  figure  12a  with  Figure  1  lb  for  the  1991  study 
with  Air  Force  pilots.  The  mean  values  of  these  quantities  are  displayed  when  averaged 
over  nine  subjects  for  one  day  of  data  and  the  four  experimental  conditions  of  interest.  It 
is  noted  that  in  Figure  12a,  much  like  Figure  lib,  that  the  experimental  condition  C1S1 
gave  rise  to  the  optimum  performance  (minimum  time  off  target)  and  highest  percent  of 
stick  output  correlated  with  the  target. 

-  To  test  this  in  a  statistical  context,  SYSTAT®  8.0  was  used  to  and  Table  III 
illustrates  the  significant  effects  from  this  ANOVA.  In  Table  III,  the  p  value  and  F  values 
are  given  for  the  dependent  performance  measure  of  interest. 


Table  III  -  ANOVA  Results  for  Stick  and  Chair  Output  Correlated  with  Target  (p<  .05*) 


Treatment  Condition 

Percent  of  Stick 

Output  Correlated 

With  Target 

Percent  of  Chair  Output 
Correlated  with  Target 

Haptics 

p  =  .005* 

p  =  0.186 

(high  or  low) 

F  =  15.116 

F  =  2.091 

Chair  Motion 

p  =  0.337 

p  <.001* 

(high  or  low) 

F=  1.042 

F  =  46.867 

Haptics  *  Chair  Motion 

p  =  0.413 

P  =  0.381 

(Interaction) 

F  =  0.747 

F  =  0.861 
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Stick  Correlation  with  Target 


Performance  and  Stick 
Correlation 


C0S1  '  C0S2  Cl  SI  C1S2 
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Optimum  Desigi,  mininum 
(time  off  target)  error  and 
maximum  stick  output 
correlated  with  the  task. 


□Performance 

IB  Percent  Stick  Correlated  wih  T  arget 


Figure  12a  -  Stick  Correlation  with  Target  Input-  9  Subjects  Averaged 


Percent  of  Chair  Output  correlated  with  chair  translation. 


Optimum  Performance 
(minimum  time  off  target) 


Experimental  Conditions 


Figure  12  b-  Chair  Correlation  with  Target  input  -  9  subjects  averaged. 


DISCUSSION  OF  THE  STICK  AND  CHAIR  ORTHOGONALITY  STUDY 


As  reflected  in  the  mean  values  of  the  variables  in  Figures  12a-b,  improved  tacking 
performance  was  more  related  to  high  correlation  of  stick  output  with  target  but  less  pronounced 
with  the  high  correlation  of  chair  output  with  the  target  tracking  signal.  The  statistical  analysis 
portrayed  in  Table  III  reflected  that  in  the  cases  where  performance  was  enhanced  (cf.  Table  II), 
the  percent  of  stick  output  correlated  with  the  target  also  was  significantly  different  (p  <  .05*).  In 
addition,  when  the  chair  motion  made  an  impact  on  the  tracking  performance,  both  results  were 
significantly  different.  Since  both  the  haptics  and  the  motion  chair  showed  main  effects,  but  their 
interactions  were  not  significant  (p<.05),  it  is  concluded  that  we  can  reject  the  null  hypothesis  that 
performance  using  these  dependent  measures  (percent  of  correlation  between  two  time  signals), 
can  be  rejected  at  a  95%  confidence  level  at  least  with  respect  to  the  stick  output,  which  has  no 
ambiguities. 


CONCLUSIONS 

It  has  been  demonstrated  from  a  physics  perspective,  from  a  mathematical 
perspective,  and  also  from  an  empirical  validation  that  in  certain  situations,  there  may  be 
some  advantage  in  providing  small  amounts  of  noise  stimulation  into  a  human  interface 
system.  The  injected  noise  is  in  the  form  of  an  alternative  sensory  modality  (haptics  and 
proprioceptive  senses  induced  by  a  joystick  and  a  motion  chair  device).  The  human 
operator  is  not  unlike  any  other  decision  making  system,  which  has  to  deal  with 
uncertainties  and  other  unknown  task  variables.  The  noise  stimulation,  when  properly 
applied  (using  haptic  and  proprioceptive  stimulation)  can  be  designed  in  a  judicious 
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manner  to  improve  the  operator’s  awareness  of  remote  environments  and  to  perform  tasks 
where  limited  visual  information  is  made  available  as  well  as  in  environments  with 
reduced  force  feedback  and  other  sensory  modalities.  This  technique  generalizes 
naturally  to  a  host  of  different  human-machine  interactions  in  which  fine-tuning  of  the 
interface  may  be  enhanced  by  appropriate  noise  stimulation. 
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APPENDIX  A  -  Derivation  of  S/N  Ratios  for  Linear  Systems 
Referring  to  Figure  13,  it  will  be  shown  in  this  appendix  that  for  a  linear  system, 
the  addition  of  the  noise  term  £(f)  to  a  deterministic  signal  S(t)  can  only  degrade  the 
signal/noise  ratio  in  the  output  variable  y(t).  To  show  this  result,  we  have  for  the  output 
of  the  linear  system  the  following  representation: 

Y(s)  =  H(s)[S(s)  +  N(s )]  (A.1) 

where  the  Laplace  transformation  notation  has  been  used  and  N(s)  is  the  frequency 
equivalent  of  the  power  spectrum  of  the  input  noise  process.  The  result  in  equation  (A.l) 
holds  due  to  the  superposition  property  of  the  linear  system  displayed  in  Figure  13.  The 
noise  process  N(s )  may  be  white-gaussian  or  possibly  a  colored  noise  process.  Since  the 
input  signal  of  interest  S(t)  is  deterministic,  we  examine  its  spectral  components  by 
allowing  5  =  jco  in  equation  (A.l).  Thus  in  the  output  signal  Y(jco),  at  each  frequency 

CO  =  Q)s,  the  total  power  is  due  to  power  contributed  by  the  deterministic  signal  S  (jco) 
as  well  as  from  the  stochastic  noise  process  N(jco) .  Since: 

Y(jco)  =  H(jco)  [S(jco)  +  N(jco )]  (A.2) 

then  the  ratio  of  signal  to  noise  appearing  in  the  output  signal  y(t)  can  be  written: 

Y_  =  [Sjm  +  NUm  H(Jco )  =  1  +  S(jco) 

YN  N(jco)  H(jco)  N(jco) 

To  see  the  effect  of  increasing  noise  on  this  signal/noise  ratio  term  in  equation  (A.3), 
Figure  14  illustrates  a  plot  of  y=l+l/x  for  positive  values  of  x  larger  than  zero.  It  is  easy 
to  show  the  decreasing  montonicity  of  this  plot  which,  for  increasing  x  from  zero,  means 
if  both  a  >  0  and  0>O  with  a>  fi,  then  it  is  strictly  true  that  y(a)  <  y(fi) . 
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APPENDIX  B  -  Derivation  of  S/N  Ratio  for  Certain  Nonlinear  Systems 

This  appendix  will  illustrate  an  effect  which  is  not  demonstrated  in  Appendix  A, 
i.e.  where  the  stochastic  disturbance,  when  added  to  a  nonlinear  system,  can  be  shown  to 
improve  certain  transfer  characteristics  of  some  important  variables.  The  results 
presented  here  will  follow  Chapeau-Blondeau,  1997  with  some  remarks  made  from  a 
very  interesting  result  demonstrated  by  Loerincz,  et  al.  1996.  In  this  notation,  the 
following  variables  will  be  used: 

Let  S(t)  =  a  coherent,  periodic,  signal  of  period  Ts. 

Let  g(t)  =  a  stationary  white  noise. 

The  white  noise  term  £( t )  has  probability  density  function  fj/u)  which  is  assumed  to  be 
normal  and  Gaussian.  The  distribution  function  of  the  random  variable  £(t)  is  specified 
via: 

Fn(u)=  £/„(«’  )du’  (B.l) 

The  nonlinear  operator  of  Figure  15  is  specified  by  g(.).  Hence  the  output  y(t)  is  of  the 
form: 

y(t)  =  g[S(t)+frt)]  (B.2) 

Thus  the  coherent  part  of  y(t)  shows  up  in  the  output  power  spectral  density  as  spectral 
lines  at  integer  multiples  of  the  coherent  frequency  \/Ts.  The  power  contained  in  the 

coherent  spectral  line  at  frequency  —  is  given  by  I  Yn  I  where  Yn  is  the  nth  order  Fourier 

coefficient  of  the  Ts  -  periodic  nonstationary  output  mean  E{y( t) }  where: 

-  1  fT,  l-Hny-X] 

r,  =  -  J0  £(>(<)) «  r-  dt  (B.3) 
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Deterministic 


Figure  15  -  SR  in  A  Nonlinear  System 


which  implies  co-^-n  is  the  nth  coherent  frequency.  This  is  well  known,  for  example, 

from  signal  processing  theory,  that  the  Fourier  transform  F{co)  of  a  time  signal  f(t)  can 
be  specified  via: 

=  dt  (B.4) 

Since  g(.)  is  a  static  nonlinearity,  the  first  and  second  moments  of  y(t)  which  operate  on 
g(.)  are  calculated.  It  is  necessary  to  realize  that  we  are  dealing  with  an  output  of  a 
nonlinear  system,  consequently  certain  superposition  properties  may  not  hold.  For  the 
first  moment,  the  mean  of  the  possibly  nonstationary  variable  E {y(t)}  can  be  computed  at 
time  t  from  the  classical  definition  of  the  first  moment  or  mean  of  a  variable,  which  is 
specified  via: 
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£{;y(0}  =  J_  g(u)fn[u-S(t)]du 


(B.5) 


where  the  density  function  fv(u  ’  )  is  modified  to  account  for  the  real  time  additivity 

between  the  deterministic  signal  S(t)  and  the  noise  source  £(t).  To  compute  the  second 
moment  of  y(t),  first  denote  (for  a  random  variable  x(t))  with  mean: 

x  =  E{x]  =  [  xf(x )  dx  (B.6) 

where  f(x)  symbolizes  the  density  function  of  the  random  variable  x(t).  The  second 
moment  <7  or  variance  of  x(t)  can  be  written  (for  the  random  variable  x (t)),  in  general, 
as: 

<72  =  E{{x-xf]  =  \\x-x)2  f{x)dx  (B.7) 

or:  <72  =  E{x2}  -  [E{x)f  =  E{x2}  -  x2  (B.8) 

When  applying  equations  (B.7  -  B.8)  to  the  output  variable  y(t),  the  second  moment 
becomes: 

var[y(01  =  JV  («)/,[« -•?(')]  <*«  -  (£ «(«)/,(« -S(0)  duf  (B.9) 

Since  this  is  a  stochastic  process,  we  define  the  mean  value  of  the  variance  of  y(t)  over 
one  period  Ts  via: 

var(y)  =  y  var[y(r)]  dt  (B.10) 

1  s 

where  var[y(f)]  is  characterized  in  (B.9).  For  the  overall  input  S(t)  +  ^(t),  the  coherent 

n 

component  is  measured  by  the  spectral  line  at  the  frequency  — .  The  coherent  power  is 
specified  via  IS„I  via  the  order  n  Fourier  coefficient  of  S(t)  as  follows: 
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(B  -11) 
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To  determine  the  transfer  characteristics  it  is  necessary  to  examine  the  output/input  at  the 
coherent  spectral  lines.  For  the  deterministic  signal  term,  the  transfer  characteristics  are 
specified  via: 


G.(i).JLL 

S,8X  is.  i 


(B.12) 


It  is  necessary  to  normalize  with  respect  to  the  two  variances  including  the  input  white 


noise  variance  <7n  as  well  as  the  deterministic  signal.  At  the  frequency  —  for  the  noise 


term  it  is  seen  that: 


G noiie 


_  Vvar(y) 


(B.13) 


The  overall  signal  to  noise  ratio  can  now  be  specified  by: 


G2sig(^) 

G2Noise( - ) 


ir,  I2  /  varQQ 
\Sn  I2  /cr 2 


(B.14) 


Thus  the  expression  in  equation  (B.14)  must  be  calculated  for  each  input  signal  (and  its 
respective  density)  as  well  as  by  the  specific  nonlinearity  that  is  operated  upon  by  the 
output  vector  y(t).  It  is  now  desired  to  examine  the  hard  nonlinearity  of  a  threshold 
which  is  of  interest  in  the  use  of  stochastic  resonance  systems  as  discussed  herein. 

The  Particular  Case  of  A  Hard  Nonlinearity  g(.)  Representing  a  Threshold: 

For  a  hard  threshold,  for  an  input  u,  the  output  y  —  g(u)  satisfies  (for  threshold  9): 

g(u)  =  0  if  u  <  0  (B.15a) 

g(u)  =  Ay  if  u>  d  (B.15b) 
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Using  the  relationships  specified  in  equations  (B.15a-b),  they  are  substituted  into  (B.5) 
and  (B.9)  resulting  in  the  following  expressions  for  this  particular  nonlinearity: 

E{y(t)}  =  Ay  [  1  -  Fv($-  S(t))  ]  (B.16) 

and  var[y(  t)]  =  A}  Fn[  6- S(t)][l-FJ0-  S(t) )]  (B.17) 

The  second  part  of  this  procedure  is  to  stipulate,  very  specifically,  the  type  of  input  signal 
and  its  characteristics.  For  this  simple  example,  the  choice  is  made  of  S(t)  being  a  train 
of  square  pulses  of  amplitude  As  >  0  of  tin  '  duration  T  seconds.  This  can  be  denoted  as: 

S(t)  =  As  forte  [0,7]  (B.18a) 

S(t)  =  0  forte  [T,  Tv]  (B.18b) 

And  the  process  is  periodic  every  Ts  seconds,  repeating  the  above  sequence  of  pulses.  For 
the  time  series  specified  in  equations  (B.18a-b),  the  Fourier  coefficients  are  given  by: 

T  T  (-inx?r) 

Sn  =  A  —  [sinc(«;r  — )  e  T- ]  (B.19) 


where  the  notation  sinc(w)  =  is  used.  This  results  in  the  following  complex 


expressions  for  the  first  and  second  moments  of  the  y(t)  output  variable  of  interest: 

_  T  T 

[F„m-  F'0-A, )]  sincOm-)  «  r' 

*  s  *  s 


(B.20) 


and  var  (y)  =  A*  {  [|-  Fv(0-A,)]  [l-Fv(6- As)]+(l-j-)  F,(0)[1-F,W]}  '  (B.21) 


This  gives  rise  to  the  following  expressions  for  the  gain  at  the  signal  and  noise 
component  of  y(t): 


G^  =  ^[F^6)~F^d~As)] 


(B.22) 
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and: 


G.*(f)  =  ^^F^e-AMl-F^e-A^  +  Q-^F^mi-F^em2  (B.23) 

.v  ^7}  *s  *s 

Thus  the  overall  signal  to  noise  gain  becomes: 

G„„  (f )  - %IF,(0)  -  F„  (0  -  K  ))2  (f  F,(0  • -  A,  )[1  -  F„(0  -  A, )] + (1  -  £)F, (F)[l  -  F,  («)] 
At  At  At  At 

(B.24) 

Now  the  presumption  was  that  the  input  noise  process  is  zero-mean  Gaussian,  hence  it  is 
characterized  by  the  distribution  function: 


Fn(u)=  Atl  +erf(-^—)] 
2  V2<7„ 


(B  25) 


Where:  erf{u)  =  2 [  exp(-« ’ 2)  d u’  /  -Jn  (B.26) 

And  Figure  16  portrays  a  simulation  of  the  signal  gain  versus  the  noise  RMS  amplitude 
for  the  special  case  of  parameters  6-  \,Ay=  1  for  the  noise  and  threshold  process.  For 
the  deterministic  input  S(t)  the  parameters  were  selected  to  be  of  the  form  T  =  10'2  Ts  and 
As  =  0.97. 


39 


Finally,  it  is  noted  in  Loerincz  et  al.,  1996,  that  Gsnr  may  exceed  1.0  for  special  input 
sequences  S(t)  with  certain  density  functions  as  is  displayed  in  Figure  16. 
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Appendix  C  -  The  Class  of  Systems  That  Exhibit  SR 

To  examine  what  type  of  systems  may  exhibit  the  effect  of  stochastic  resonance,  a 
few  preliminaries  are  in  order  (Strogatz,  1994).  This  analysis  will  be  conducted  from  an 
energy  perspective  and  it  will  be  useful  to  visualize  the  dynamics  of  a  nonlinear  system 
based  upon  potential  energy.  Let  V ( x )  denote  the  potential  energy  of  a  nonlinear  system 
(and  f(x)  is  the  force)  which  is  required  to  be  specified  via: 

x(t)  =  /(*)'  =  ~  (C.l) 

ax 


Hence  the  systems  under  consideration  (for  simplicity)  will  be  nonhomogenous  and  of 
the  autonomous  type,  i.e.  f(x)  depends  only  on  x  and  not  on  the  time  variable  t.  There 
are  physical  reasons  why  the  representation  in  equation  (C.l)  is  chosen.  From  physics, 
force  is  the  negative  gradient  of  potential  energy  and  thus  equation  (C.l)  represents  a 
physical  system  with  V  in  the  role  of  the  potential  energy  function  and  f(x)  representing  a 
force  vector.  To  make  the  system  physically  realizable,  motion  is  produced  on  a  particle 
sliding  down  the  walls  of  a  potential  well  (characterized  by  the  potential  energy 
function).  Thus  as  the  particle  moves  “downhill,”  the  motion  proceeds.  As  the  particle 
moves,  it  tries  to  achieve  a  lower  potential  energy  (hence  V  is  decreasing  as  we  ride  down 
the  negative  gradient).  From  the  chain  rule,  the  time  derivative  of  V(x)  can  be  written: 


dV__dV_  dx 
dt  dx  dt 


(C.2) 


But  we  chose  only  those  nonlinear  systems  constrained  to  be  of  the  form  (of  (C.l)  i.e.): 


dx  =  _dV_ 
dt  dx 


(C.3) 


because  of  the  relationship  mandated  in  equation  (C.l).  Hence  it  follows  from  (C.2)  that: 
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M  dV 
dt  dx  dx  dx 


(C.4) 


Thus  V(x)  decreases  along  motion  trajectories  and  the  particle  moves  toward  a  lower 

dV 

potential  energy.  At  an  equilibrium  point  (fixed  point),  then  —  =  0  and  V  remains 

dx 


constant.  This  is  also  verified  by  the  fact  that: 

dV 


dx 


=  -x  =  0 


(C.5) 


is  also  a  definition  of  an  equilibrium  (fixed  point)  since  x  =  0  is  now  satisfied  in 
equation  (C.5).  Thus  a  local  minimum  of  V(x)  corresponds  to  a  stable  fixed  point  while 
a  local  maximum  of  V(x)  corresponds  to  an  unstable  fixed  point.  Also  from  nonlinear 
dynamics  (Strogatz,  1994),  the  fixed  points  must  oscillate  between  stable  and  unstable 
equilibriums  in  a  phase  plane  representation  (assuming  real  fixed  points),  otherwise  chaos 
will  occur.  The  following  example  illustrates  how  to  use  results  presented  in  the  analysis 
so  far. 

Example; 

,  dV 

Consider  the  system:  x  =  x  -  x  =  -  -  (C.6) 

dx 

To  find  the  V(x)  function,  the  first  integral  (with  respect  to  x)  of: 


dV 

dx 


-I x-x 3] 


yields: 

V(x)  =  --  x2  +  -  x4  +  C 
2  4 

First  we  set  C=0  and  find  (by  setting  the  right  hand  side  of  (C.6)  to  zero  to  find  the 


(C.7) 

(C.8) 


equilibrium  points)  that  a  local  minimum  of  V(x)  exists  at  x  =  _L  1  and  a  local  maximum 
exists  at  x  =  0.  Since  the  local  minima  are  separated  by  a  local  maximum,  this  system  can 
demonstrate  stochastic  resonance.  This  is  a  double-well  potential  surface  and  the  system 
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is  said  to  be  bistable  since  it  has  two  stable  equilibria  (separated  by  an  unstable 
equilibrium  point).  Figure  17  for  V(x)  and  Figure  18  illustrate  the  fixed  points  of  this 
example  (cf.  Figures  2-3). 

To  show  a  linear  system  can  never  exhibit  stochastic  resonance,  start  first  with: 

dV 

=  /(*)  =  x  (C.9) 

dx 

If  f(x)  were  linear  in  x,  then  V(x)  (the  first  spatial  integral  of  (C.9))  would  be  of  the  order 
of  0(x2),  at  worst.  Taking  the  first  derivative  of  V(x)  and  setting  it  to  zero  would  yield 
only  one  maximum  or  minimum.  Hence,  there  exists  only  one  fixed  point  for  a  linear 
system.  From  Figures  17-18,  it  is  known  that  at  least  three  fixed  points  are  required 
with  a  local  maximum  occurring  between  two  local  minimums  in  order  for  stochastic 
resonance  to  transpire.  From  this  discussion,  the  following  rules  can  be  gleaned  for  the 
type  of  nonlinear  systems  that  would  exhibit  stochastic  resonance: 

Rules  for  nonlinear  systems  to  exhibit  stochastic  resonance  ( x  =  fix)): 

(1)  f(x)  must  have  powers  x  of  3  or  higher  (at  least  3  fixed  points  must  occur). 

(2)  The  fixed  points  resulting  from  setting  f(x)  =0  must  have  two  local  minimums 
(stable  fixed  points)  separated  by  a  local  maximum  (an  unstable  fixed  point). 

Note  there  are  an  infinite  class  of  systems  that  satisfy  the  above  two  conditions  and 
fix)  may  contain  higher  powers  of  x  but  the  fixed  points  must  be  interlaced  and 
alternated  between  stable  and  unstable  equilibriums.  Some  additional  systems  are  now 
listed  that  also  exhibit  SR  effects,  which  are  synthesized,  based  on  the  above  discussion. 

x  =  (x  +  1)  [2+x][2-x]  (C-10) 

x  =  ix+2)  [4+jc]  [4-x]  [10+x][10-jc]  (C-ll) 
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V(x)  versus  x  function 


Figure  17- V(x)  versus  x 
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Figure  18-  Fixed  Points  for  Figure  17 


X  =  (jc  +  4)  [6+ jc]  [6-x]  [8  +  x][8-jc][10+jc][10-jc] 
etc.  Thus  a  method  is  given  to  synthesize  nonlinear  systems  so  that  SR  occurs 


x=  +1 
Stable 


